Skip to content

Add always-on build telemetry delivery - #1099

Merged
anth-volk merged 10 commits into
mainfrom
codex/always-on-telemetry-emitter
Oct 8, 2026
Merged

anth-volk merged 10 commits into
mainfrom
codex/always-on-telemetry-emitter

Conversation

@anth-volk

@anth-volk anth-volk commented Oct 2, 2026 •

Copy link
Copy Markdown
Contributor

Summary

  • start a local telemetry emitter service automatically for supported US and UK dataset builds
  • keep network access, Hugging Face authentication, retries, process sampling, and the bounded SQLite queue outside the build process
  • use HF_TOKEN, HUGGINGFACE_TOKEN, or the cached Hugging Face login automatically; no telemetry configuration is required for PolicyEngine members
  • exchange only the Hugging Face credential for one short-lived collector session credential, then register runs and upload events with that credential
  • use one fixed production collector origin with no production destination override; retain only an explicit loopback option for development
  • permanently keep a run local when no Hugging Face credential exists or membership is rejected, including across process restarts, while retaining transient failures for retry
  • report stage transitions, graph-node and batch progress, calibration progress, resource use, heartbeats, completion, and classified failures without allowing collector availability to fail a build

The hosted collector and dashboard integration are in PolicyEngine/calibration-diagnostics#199.

Verification

  • focused telemetry suite: 17 tests passed
  • affected US release and UK build suites: passed with two expected skips
  • Ruff check and format on changed Python files: passed
  • repository diff check: passed

@anth-volk
anth-volk merged commit de80da3 into main Oct 8, 2026
10 checks passed
@anth-volk
anth-volk deleted the codex/always-on-telemetry-emitter branch October 8, 2026 20:34
juaristi22 added a commit that referenced this pull request Oct 12, 2026
Main re-pinned the Chronicle feed to 1ee7dfe (352,549 rows) and merged
#1167, #1087 and #1099 among 87 commits. On the merged tree: the PRIS
resource is re-vendored from the new pin (44 rows unchanged), the target
references, membership and both national compile-parity receipts are
regenerated against it (1,245 active references: main's 1,232 plus the 13
SPI property amounts), the release input coverage manifest and the H2
fixture are re-derived, the gate-battery and certification part digests
move with the merged gates.json, and the count pins follow. The commits
below this one keep the surfaces they were measured with.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
juaristi22 added a commit that referenced this pull request Oct 12, 2026
Main re-pinned the Chronicle feed to 1ee7dfe (352,549 rows) and merged
#1167, #1087 and #1099 among 87 commits. On the merged tree: the PRIS
resource is re-vendored from the new pin (44 rows unchanged), the target
references, membership and both national compile-parity receipts are
regenerated against it (1,245 active references: main's 1,232 plus the 13
SPI property amounts), the release input coverage manifest and the H2
fixture are re-derived, the gate-battery and certification part digests
move with the merged gates.json, and the count pins follow. The commits
below this one keep the surfaces they were measured with.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant